基于变压器的语言模型如BERT在大量英语基准上表现出以前的模型，但他们的评估通常限于英语或少量资源的语言。在这项工作中，我们在伯特家族上评估了各种尿潴留的单语，多语言和随机初始化的语言模型，包括爱沙尼亚，芬兰语，匈牙利语，erzya，Moksha，Karelian，Livvi，Komi Permyak，Komi Zyrian，Northern S \' ami，和skolt s''mi。当单晶模型可用时（目前只能等，FI，HU），这些在其母语上表现更好，但一般来说，它们比共享相同字符集的基因无关语言的多语言模型或模型转移。值得注意的是，即使没有特殊努力对封路计优化的特殊努力，高资源模型的直接转移会产生似乎是少数民族尿路语言的艺术POS和NER工具的似乎是有足够的芬特数据的态度。

Residual minimization is a widely used technique for solving Partial Differential Equations in variational form. It minimizes the dual norm of the residual, which naturally yields a saddle-point (min-max) problem over the so-called trial and test spaces. Such min-max problem is highly non-linear, and traditional methods often employ different mixed formulations to approximate it. Alternatively, it is possible to address the above saddle-point problem by employing Adversarial Neural Networks: one network approximates the global trial minimum, while another network seeks the test maximizer. However, this approach is numerically unstable due to a lack of continuity of the text maximizers with respect to the trial functions as we approach the exact solution. To overcome this, we reformulate the residual minimization as an equivalent minimization of a Ritz functional fed by optimal test functions computed from another Ritz functional minimization. The resulting Deep Double Ritz Method combines two Neural Networks for approximating the trial and optimal test functions. Numerical results on several 1D diffusion and convection problems support the robustness of our method up to the approximability and trainability capacity of the networks and the optimizer.

To apply federated learning to drug discovery we developed a novel platform in the context of European Innovative Medicines Initiative (IMI) project MELLODDY (grant n{\deg}831472), which was comprised of 10 pharmaceutical companies, academic research labs, large industrial companies and startups. The MELLODDY platform was the first industry-scale platform to enable the creation of a global federated model for drug discovery without sharing the confidential data sets of the individual partners. The federated model was trained on the platform by aggregating the gradients of all contributing partners in a cryptographic, secure way following each training iteration. The platform was deployed on an Amazon Web Services (AWS) multi-account architecture running Kubernetes clusters in private subnets. Organisationally, the roles of the different partners were codified as different rights and permissions on the platform and administrated in a decentralized way. The MELLODDY platform generated new scientific discoveries which are described in a companion paper.

农场动物成像的各种应用基于某些身体部位的重量和从动物的CT图像切割的估计。在许多情况下，由于扫描非镇静的活动物，通过CT图像中的姿势的巨大变化来增加问题的复杂性。在本文中，我们提出了一种估计来自（可能）活体动物的CT图像的切割和身体部位的重量的一般和鲁棒方法。我们通过弹性登记和联合功能和用于斗篷的回归分量的模型选择，适应基于多标准的分段以及具有大量特征和较少量的样本。通过兔育种程序中的真实应用来评估和说明所提出的技术，显示R ^ 2比以前的技术和方法高于以前的技术和方法。所提出的技术很容易适应类似的问题，因此，它在开源软件包中共享，以便为社区的利益。